# GGUF Format

This is a static quantized version of the chandar-lab/NeoBERT model, aiming to reduce model storage space and computational resource requirements.

This is a statically quantized version based on the Qari-OCR-0.3-SNAPSHOT-VL-2B-Instruct-merged model, mainly used for image-to-text conversion tasks.

Static quantized version of Qwen2-Audio-7B-Instruct model, supporting English audio-to-text conversion tasks

Vintern-1B-v3_5 is a 1-billion-parameter vision-language model supporting image-text generation tasks.

This is a GGUF format conversion version based on the Wan-AI/Wan2.1-T2V-14B model, primarily used for text-to-video generation tasks.

INTELLECT-2-GGUF is the GGUF format quantized version of PrimeIntellect/INTELLECT-2, suitable for text generation tasks.

Clinician-Note-2.0a is a text generation model specialized in the medical field, specifically designed for clinical note and summarization tasks.

SkyReels-V2-I2V-14B-540P is a GGUF-format converted image-to-video model that supports generating dynamic video content from static images.

This is a Turkish text-to-speech (TTS) model based on the Orpheus architecture, converted to GGUF format for use with llama.cpp.

Kokoro is a text-to-speech (TTS) model offering GGUF-encoded versions with dual phonemization support.

This is a statically quantized version of a T5-based news summarization model, supporting English text summarization tasks.

GGUF quantized version of Gemma 3 12B, suitable for text generation tasks.

GGUF quantized version of the Gemma 3B model, suitable for local text generation tasks

Static quantized version based on kriton/greek-text-summarization, specialized for Greek text summarization tasks

VISION-1 is a content moderation and safety classification model based on transformers, focusing on text classification tasks.

GGUF format model file of Parler TTS Mini v1 for text-to-speech tasks, supporting the English language.

This model is converted from BAAI/bge-reranker-base into the GGUF format, primarily used for text reordering tasks.

Glm-Edge-V-5B-GGUF is a multilingual image-text generation model supporting Chinese and English, developed based on the GLM architecture.

This model is a GGUF-converted version of google-t5/t5-large, supporting tasks like summarization and translation, and is applicable to multiple languages including English, French, Romanian, German, and more.

ChromaFur Alpha is a text-to-image generation model converted to GGUF format, suitable for low-end GPUs or users who prefer fast loading.

Yi-Coder-1.5B-Chat-GGUF is the GGUF format model file of 01-ai/Yi-Coder-1.5B-Chat, suitable for text generation tasks.

Experimental GGUF-converted version of Flux.1-dev, featuring various mixed-precision quantization schemes

GGUF format model file for Phi-3.5-mini-instruct, suitable for text generation tasks.

MADLAD-400 3B multilingual translation model, supporting translation tasks for over 400 languages, optimized in GGUF format.

This is a Llama3 model fine-tuned on the PubMedQA dataset, specializing in medical Q&A tasks.

GGUF quantized version of the Gemma 2B model, suitable for local deployment and inference

This is the GGUF format quantized version of the defog/sqlcoder-7b-2 model, primarily used for SQL code generation tasks.